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SUMMARY 


In  this  work,  we  present  a  new  graph-theoretic  algorithm  for  the  purpose  of  exploiting  parallelism 
in  the  sparsity  structure  of  large  symmetric  matrices.  The  key  objectives  of  the  algorithm  are  to  iden¬ 
tify  full  blocks  in  a  symmetric  matrix  M  that  can  be  factored  independently  of  each  other  and  also  to 
keep  the  number  of  fill  elements  generated  in  the  process  of  factoring  the  blocks  as  small  as  possible. 
The  graph-theoretic  algorithm  has  running-time  proportional  to  the  number  of  vertices  and  edges  in  an 
undirected  graph,  making  the  algorithm  very  suitable  for  extremely  large  sparse  symmetric  problems. 

Using  this  graph-theoretic  algorithm,  we  develop  a  block  method  for  the  solution  of  sparse  sym¬ 
metric  linear  systems  of  equations.  This  block  method  takes  full  advantage  of  the  parallel  capabilities 
of  high-performance  computers  and  makes  good  use  of  the  standard  routines  in  the  quality  linear 
algebra  library  LAPACK  to  perform  the  numerical  computations  in  terms  of  Level  2  and  Level  3 
Basic  Linear  Algebra  Subprograms  (BLAS)  operations. 

There  are  many  defense  critical  applications  in  the  Navy  in  the  areas  of  signal  processing,  struc¬ 
tural  mechanics,  and  computational  hydrodynamics  that  give  rise  to  large  sparse  symmetric  matrices. 
We  strongly  recommend  the  implementation  of  the  presented  algorithms  and  their  application  to  these 
problems. 
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INTRODUCTION 


The  availability  and  widespread  use  of  high-performance  computers  and  quality  linear  algebra  pro¬ 
grams  has  contributed  toward  gaining  greater  understanding  of  the  deep  interplay  between  data  move¬ 
ment  to  and  from  high-speed  memory  and  linear  algebra  operations.  Today’s  high-performance 
computer  architectures  incorporate  complex  hierarchy  of  memory  levels  with  registers  at  the  top,  fol¬ 
lowed  by  cache  and  main  memory  at  the  bottom.  Data  movement  between  these  memory  levels  is 
computationally  costly  and  should  be  reduced  as  much  as  possible.  The  key  strategy  that  has  emerged 
from  high-speed  memory  traffic  considerations  is  the  restructuring  of  matrices  into  blocks  and  to  per¬ 
form  block  matrix  operations  such  as  matrix-matrix  multiplication,  solving  triangular  systems  with  mul¬ 
tiple  right-hand  sides,  and  rank-k  matrix  updates.  These  block  matrix  operations  are  referred  to  as 
Level  3  Basic  Linear  Algebra  Subprograms  (BLAS)  (Anderson  et  al.,  1990).  When  all  the  blocks  are 
of  dimension  n,  block  algorithms  provide  floating-point  operations  with  O(n^)  data  movement. 

In  sharp  contrast  to  this,  algorithms  operating  only  on  vectors  of  data  (Level  1  BLAS)  or  performing 
matrix-vector  operations  (Level  2  BLAS)  are  incapable  of  attaining  such  high  ratios  of  floating-point 
operations  to  memory  references.  Block  algorithms  are  also  suited  for  high-performance  computers 
with  multiple  processors  since  all  scalar,  vector,  and  matrix  operations  on  individual  blocks  may  be 
performed  in  parallel. 

For  dense  and  banded  matrices,  highly  efficient  block  algorithms  have  been  developed  for  the 
solution  of  systems  of  linear  equations,  finding  least-squares  solutions  of  overdetermined  systems  of 
equations  and  solving  eigenvalue  problems  (Anderson  et  al.,  1990).  In  the  case  of  general  sparse 
matrices,  the  subject  is  less  understood. 

Let  M  be  any  structurally  symmetric  sparse  matrix  with  a  nonzero  main  diagonal.  The  objective  of 
this  work  is  to  develop  a  block  algorithm  that  takes  full  advantage  of  the  vector  and  parallel  capabili¬ 
ties  of  today’s  high-performance  computers  for  the  solution  of  the  system  of  linear  equations 

Mx  =  b  . 

There  are  two  key  goals  within  our  objective.  First,  we  want  to  exploit  all  parallelism  in  the  spar¬ 
sity  structure  of  the  matrix  M.  The  main  aim  here  is  to  identify  full  blocks  in  M  that  can  be  factored 
in  parallel  on  the  different  processors  in  a  parallel  machine.  Second,  we  wish  to  exploit  the  sparsity  of 
the  matrix  M,  to  keep  the  number  of  fill  elements  generated  in  the  process  of  factoring  t’.'-  blocks  as 
small  as  possible.  It  is  worth  noting  that  the  problem  of  minimizing  the  number  of  fill  cLments  in  the 
unsymmetric  case  is  nondeterministic  polynomial-time  (NP)  complete  (Rose  and  Ta’"  i,  1975)  and 
thus  computationally  intractable. 

Algorithmic  research  and  software  development  over  the  last  two  decades  has  brought  about  many 
methods  for  exploiting  sparsity  in  symmetric  and  unsymmetric  matrices.  Among  these  methods,  the 
minimum  degree  algorithm  (George  and  Liu,  1981;  Tinney,  1969)  stand.;  out  as  the  most  popular  and 
widely  used  ordering  scheme  for  keeping  the  number  of  fill  elements  '..i  symmetric  matrices  small.  In 
this  work,  we  develop  a  new  method  for  exploiting  the  sparsity  sir  dure  of  symmetric  matrices.  The 
key  idea  is  based  on  the  graph-theoretic  concept  of  simplicial  v'^r'ex  (Dirac,  1961;  Lekkerkerker  and 
Boland,  1962).  Simplicial  vertices  were  first  introduced  by  Dime  (1961)  to  show  that  a  rigid  circuit 
graph  (a  chordal  graph  in  today’s  graph-theoretic  terminology)  has  a  simplicial  vertex.  Lekkerkerker 
and  Boland  (1962)  formally  defined  and  used  simplicial  vertices  in  their  study  of  interval  graphs. 

Here,  we  use  simplicial  vertices  to  introduce  the  concept  of  an  elite  clique  in  an  undirected  graph  G. 
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An  elite  clique  in  G  is  a  clique  with  the  following  two  properties;  (a)  every  vertex  in  the  clique  is  a 
simplicial  vertex  and  (b)  an  elite  clique  is  not  a  proper  subset  of  any  other  elite  clique  in  G. 

Suppose  G  is  the  undirected  graph  of  the  structurally  symmetric  matrix  M.  Let  Gi,...,  G*  be  any 
k  distinct  elite  cliques  in  G.  If  A„  is  a  block  in  Af  such  that  G,  is  its  graph  for  then  we 

prove  the  following  three  properties  of  an  elite  clique.  First,  each  of  the  blocks  A], A**  can  be 

factored  without  giving  rise  to  any  fill  element  in  A.  Second,  the  blocks  An . A**  can  be  factored 

in  parallel  independently  of  each  other.  Third,  the  set  of  all  elite  cliques  in  G  is  unique.  From  the 
second  property  of  an  elite  clique,  it  becomes  immediately  apparent  that  by  exploiting  sparsity  through 
the  concept  of  elite  cliques  we  automatically  achieve  our  goal  for  exploiting  parallelism  in  a  symmetric 
matrix. 

While  the  concept  of  elite  cliques  provides  a  solid  theoretical  background  for  the  study  of  sparse 
symmetric  matrices  on  parallel  machines,  there  remains  the  algorithmic  problem  of  efficiently  con¬ 
structing  the  elite  cliques  in  a  general  undirected  graph  G.  We  carry  out  this  objective  by  introducing 
the  concept  of  the  core  of  a  clique.  As  an  immediate  consequence  to  a  result  we  give  on  core  cliques, 
we  derive  an  algorithm  that  partitions  the  vertex  set  in  the  graph  G  into  two  disjoint  sets  X  and  S  such 
that  every  elite  clique  in  G  is  a  connected  component  of  the  subgraph  of  G  induced  by  the  vertex  set 
X.  The  partitioning  algorithm  is  linear  in  the  number  of  vertices  and  edges  in  G.  Using  this  partition¬ 
ing  we  obtain  a  set  of  cliques  in  G  with  the  property  that  every  elite  clique  in  G  is  an  element  of  this 
set,  and  furthermore,  no  two  cliques  in  this  set  are  connected  by  any  edge  in  G.  We  call  such  a  set  of 
cliques  an  independent  cliques  set.  Thus,  a  key  contribution  of  this  work  is  a  linear  algorithm  that 
constructs  an  independent  cliques  set  in  G  such  that  every  elite  clique  in  G  is  an  element  of  this  set. 

If  the  graph  G  does  not  contain  any  elite  clique,  we  show  that  the  ordering  scheme  resulting  from  the 
construction  of  the  independent  cliques  set  is  as  competitive  as  the  minimum  degree  algorithm. 

Given  an  independent  cliques  set  of  size  k,  we  are  able  to  restructure  a  structurally  symmetric 
matrix  M  into  a  2  by  2  block  matrix 


PMP^ 


A  B 
C  D 


where  F  is  a  permutation  matrix  and  A  is  a  by  t  block  diagonal  matrix  with  full  square  diagonal 
blocks.  Using  PMT^,  we  derive  a  block  algorithm  for  the  solution  of  symmetric  linear  systems  of 
equations  with  special  emphasis  on  the  case  where  M  is  a  positive  definite  matrix.  The  entire  block 
algorithm  is  organized  to  perform  three  types  of  numerical  computations.  First,  the  k  square  diagonal 
blocks  of  A  are  factored  in  parallel  (a  Level  2  BLAS  operation).  Second,  k  full  triangular  systems 
with  multiple  right-hand  sides  are  solved  in  parallel  (a  Level  3  BLAS  operation).  Third,  the  Schur 
complement  D-C  B  is  computed  using  matrix-matrix  multiplications  (another  Level  3  BLAS  opera¬ 
tion).  If  the  Schur  complement  is  dense,  the  algorithm  proceeds  by  solving  a  dense  linear  system  of 
equations  in  which  the  coefficient  matrix  is  the  Schur  complement.  Otherwise,  the  matrix  M  is  set  to 
D-CA"'  B  and  the  entire  process  is  repeated. 


In  summary,  the  block  algorithm  presented  in  this  work  takes  full  advantage  of  the  parallel  and 
vector  capabilities  of  high-performance  computers.  Furthermore,  the  algorithm  makes  extensive  use  of 
standard  routines  for  dense  problems  to  perform  the  numerical  computations  in  terms  of  Levels  2  and 
3  BLAS  operations. 
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NOTATION  AND  BACKGROUND 


A  graph  G=(V,E)  consists  of  a  finite,  nonempty  set  of  vertices  V  and  a  set  of  edges  E.  If  the 
edges  are  ordered  pairs  (u,v)  of  vertices,  G  is  said  to  be  directed.  If  the  edges  are  unordered  pairs  of 
distinct  vertices,  also  denoted  by  (w,v),  G  is  said  to  be  undirected.  A  bipartite  graph  B-{U,V,E)  is  an 
undirected  graph  consisting  of  two  disjoint  vertex  sets  U  and  V  and  a  set  of  edges  E  such  that  every 
edge  has  one  end  point  in  G  and  the  other  in  V.  For  a  set  of  vertices  U  in  G=(V,E),  the  graph 
G(U)-{U,  E(U)),  where  E(U)={{u,v)  G  £[  u,v  G  U},  is  called  the  subgraph  of  G  induced  by  the  ver¬ 
tex  set  U.  An  induced  subgraph  G{U)  in  G  is  called  a  clique  if  every  vertex  in  G(U)  is  connected  to 
every  other  vertex  in  G(U).  A  clique  is  maximal  if  it  is  not  a  proper  subgraph  of  another  clique.  A  set 
of  cliques  Cff/j ),...,  G(Ur)  in  G-(V,E)  is  called  a  clique  partition  of  G  if  the  t//  ’s  form  a  partition 
of  the  vertex  set  V.  A  set  of  vertices  S  is  a  separator  of  the  connected  graph  G=(V,E)  if  the  induced 
subgraph  G(V-5j  is  disconnected.  A  set  of  vertices  F  in  G=(V,E)  is  a  feedback  vertex  set  if  G(V-F)  is 
acyclic.  All  graphs  considered  in  this  paper  are  undirected. 

A  vertex  u  is  said  to  be  adjacent  to  another  vertex  v  in  the  graph  G={V,E)  if  (u,v)  G  E.  The  set 

adj^u  =  {v  G  V'-{u}|(u,v)  G  E) 


is  the  set  of  vertices  adjacent  to  u. 

The  degree  of  a  venex  u  in  G,  denoted  by  degQU,  is  the  number  of  edges  incident  with  u  in  G  and 
so  degQU=\adjQu\.  A  set  of  vertices  /  in  G  is  an  independent  (stable)  set  if  no  two  vertices  in  I  are 
adjacent.  An  independent  set  is  maximal  if  it  is  not  a  proper  subset  of  another  independent  set. 

For  a  vertex  u  in  the  graph  G=(V,E),  the  deficiency  of  «  in  G  is  the  set  of  edges  def^u  defined  by 

deff^^u  =  {{v,w)\v,w  E  adjQU,  (v,w)  ^  E,v  ^  w}  . 

Clearly,  every  vertex  u  in  G  with  degc,  <  1  has  empty  deficiency. 

For  a  vertex  u  in  G-(V,E),  the  graph 

G^=  (V^-{m},£(F-{u})  U  deff^u) 

obtained  by  adding  def^u  to  G(V'-{m})  is  called  the  M-elimination  graph  (Rose,  Tarjan,  and  Lueker, 
1976). 

The  concept  of  «-elimination  graph  first  introduced  by  Parter  (1961)  plays  a  fundamental  role  in 
the  study  of  Gaussian  elimination  on  symmetric  matrices.  To  establish  the  key  matrix-theoretic  prop¬ 
erty  of  a  u-elimination  graph,  assume  G  is  the  graph  of  an  n  by  n  structurally  symmetric  matrix  M  and 
that  the  leading  block  A  in  the  2  by  2  block  matrix  PMT  is  a  1  by  1  nonsingular  matrix.  Let  u  be 
the  vertex  in  G  representing  the  row  of  A.  .\ssuming  no  cancellation  of  nonzero  elements,  the  follow¬ 
ing  result  by  Parter  (1961)  on  elimination  graphs  is  well-known. 

Lemma  1.  Gu  is  the  graph  of  the  Schur  complement  D  -  CA^'B . 

Since  the  induced  subgraph  G(V-{u\)  is  the  graph  of  the  block  D,  by  the  construction  of  Gu  it  is 
immediate  that  every  element  of  the  deficiency  set  defQU  represents  a  fill  element  in  the  Schur  com¬ 
plement  D-CA~'  B.  Alternately,  the  block  D  and  the  Schur  complement  D-CA  ^B  have  identical 
zero-nonzero  structure  if  def(^u=0.  This  observation  elucidates  the  importance  of  vertices  with  empty 
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deficiencies  in  Gaussian  elimination.  Accordingly,  we  call  a  vertex  u  with  defQU=0  a  perfect  elimina¬ 
tion  vertex.  In  the  same  spirit,  we  call  a  graph  without  any  perfect  elimination  vertex  an  imperfect 
elimination  graph. 

Another  important  property  of  a  «-elimination  graph,  which  immediately  follows  from  the 
definition  of  the  deficiency  set  defcu  is  stated  next. 

Lemma  2.  The  subgraph  induced  by  the  vertex  set  adj^u  is  a  clique  in  Gu- 

This  simple  but  very  useful  result  highlights  the  imponant  fact  that  cliques  are  inherent  in  elimina¬ 
tion  graphs,  and  thus  the  study  of  cliques  in  graphs  may  contribute  to  the  efficient  solution  of  systems 
of  equations  by  Gaussian  elimination. 
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ELITE  CLIQUES 

We  begin  by  introducing  some  clique-related  concepts  that  play  key  roles  in  subsequent  develop¬ 
ments. 

For  any  clique  G{U)  in  the  graph  G=(y,E),  the  interior  of  G{U)  is  the  vertex  set  int{U)  defined 
by 

int(U)  =  {u  e  U\adjQ  =  . 

If  int(U)  ^  0,  then  the  subgraph  induced  by  the  vertex  set  int{U)  is  called  an  elite  clique  in  G. 

From  the  construction  of  the  vertex  set  int(U)  it  is  immediate  that  for  every  vertex  u  in  int{U)  the 
induced  subgraph  G{adjQu)  is  a  clique  since  G(LI)  is  a  clique.  A  vertex  satisfying  this  property  has 
been  called  a  simplicial  vertex  (Lekkerkerker  and  Boland  (1962)).  Thus,  every  vertex  in  an  elite 
clique  is  a  simplicial  vertex.  In  addition  to  this  property  of  an  elite  clique,  it  is  easy  to  see  that  no 
elite  clique  is  a  proper  subgraph  of  any  other  elite  clique  in  G. 

Since  the  set  of  vertices  adjacent  to  a  simplicial  vertex  induces  a  clique,  by  Lemma  2  it  follows 
that  a  simplicial  vertex  is  precisely  a  perfect  elimination  vertex.  Thus,  simplicial  vertices  are  ideally 
suited  for  efficient  Gaussian  elimination.  In  what  follows,  we  show  that  an  entire  elite  clique  shares 
this  important  property. 

Let  G(U)  be  any  clique  in  the  graph  G=(y,E)  with  |f/|=m  and  let  a  be  any  ordering  of  the  verti¬ 
ces  in  U.  Suppose  we  wish  to  generate  a  sequence  of  elimination  graphs  using  the  vertices  Q!(1),  q(2), 
...,  a(m)  in  that  order.  Suppose  Go=G.  Then,  using  the  notion  of  elimination  graph  adopted  earlier, 

we  obtain  the  following  sequence  of  graphs  Gi=(Go)a(i).  02=(Gj)„(2) .  Om=(Gm-i)a(m)-  we  let 

G,  =(  K, ■,£,  ),  for  i=0,  1,...,  m,  then  by  the  construction  of  an  elimination  graph  we  obtain 

V,.  =  Fi.,  -  {a(0} 


£'^  =  £,.,(V,)  u  defc._^aO')  , 


/  =  1 . m. 


The  endmost  graph  Gm  -G\a\  >n  the  sequence  of  elimination  graphs  C),...,Gm  is  of  particular 
interest  in  subsequent  developments.  We  call  G\a\  the  a-elimination  graph. 

As  each  edge  in  the  edge  sets  def^.  ^otU)  for  /=1,...,  m  represents  a  fill  element,  the  set  FqO 
defined  by 

m 

i  =  1 

is  called  the  a-fill  in  G.  Consistent  with  the  definition  of  a  perfect  elimination  vertex  in  the  graph  G, 
we  call  a  clique  G{U)  a  perfect  elimination  clique  if 

Fg<i  =  0 

for  any  ordering  a  of  the  vertices  in  U.  Thus,  if  G{U)  is  a  perfect  elimination  clique  then 

G|„|-C(F-G)  . 

This  is  an  extremely  desirable  property  in  Gaussian  elimination  since  the  graph  G  is  reduced  to 
the  induced  subgraph  G(V-U)  without  creating  any  fill  element  in  the  matrix  corresponding  to  G. 

We  are  now  in  position  to  state  the  key  sparsity-pre.serving  property  of  an  elite  clique. 
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Theorem  1.  Every  elite  clique  in  G-{V,E)  is  a  perfect  elimination  clique. 

Proof 

Let  G(U)  be  any  elite  clique  in  G  and  let  a  be  any  ordering  of  the  vertices  in  U.  We  will  prove 
this  theorem  by  induction  on  |(/|.  Since  G(U)  is  an  elite  clique,  every  vertex  in  G(U)  is  a  simplicial 
vertex  and  so  the  first  vertex  a(l)  in  the  ordering  a  is  a  perfect  elimination  vertex  in  G.  Thus,  the 
deficiency  defQ^Oi{\)  of  vertex  a(l)  in  Go=G  is  the  empty  set.  Now  assume  that  def^^ail)  -  ...  = 
defo.  ^a{i)-0  for  any  /<|t/|.  Then,  the  elimination  graph  Gj.  j  is  a  subgraph  of  the  original  graph  G 
and  so  the  subgraph  induced  by  the  vertex  set  G'=t/-{a(l),  ...,  ck(/)}  is  an  elite  clique.  This  means 
that  the  vertex  a(i+l)  is  a  simplicial  vertex  in  G,_  j  and  so  we  get  defQ.  ^a(f+l)=0.  Hence,  FQa=0 
and  the  proof  is  complete. 

□ 

Up  to  now  we  have  been  exploiting  sparsity  from  the  viewpoint  of  minimizing  fill  elements.  Our 
next  task  is  to  exploit  parallelism  inherent  in  the  sparsity  structure  of  a  structurally  symmetric  matrix. 
We  begin  by  introducing  the  concept  of  an  independent  cliques  set. 

Given  any  graph  G=(V,E),  the  collection  of  induced  subgraphs 

Ic  =  {G(U)\G(U)  is  a  clique,  G(U)  is  a  connected  component  of  GCU  ^  ,  U) 

G(t/)  e 

is  called  an  independent  cliques  set. 

From  the  construction  of  the  set  Ic,  it  is  immediate  that  for  any  two  vertices  u  and  v  in  V  such 
that  u  and  v  are  in  two  different  cliques  in  Ic  we  have  (m,v)  ^  E.  Thus,  an  independent  cliques  set 
in  a  graph  G  gives  rise  to  a  family  of  independent  sets  of  size  |  /d  in  G,  and  so  the  concept  of  inde¬ 
pendent  cliques  set  is  a  natural  extension  of  an  independent  set. 

The  next  property  of  an  elite  clique  shows  that  the  exploitation  of  sparsity  through  the  concept  of 
elite  cliques  automatically  carries  out  our  other  goal  of  exploiting  parallelism. 

Theorem  2.  Let  G(G/),  ...,  G(G*)  be  any  k  distinct  elite  cliques  in  G={V,E).  Then  the  following 
statements  hold. 

(a)  For  any  u,  S  G, ,  k,  the  set  {a, ,  ...,  «*}  is  an  independent  set  of  size  k. 

(b)  Ic  =  {G(,U^)\  /=1 . k}  is  an  independent  cliques  set  of  size  k. 

(c)  If  then  the  vertex  set  K-U  G,  is  a  separator  of  G. 

Proof 

(a)  If  k=l,  there  is  nothing  to  prove.  Suppose  ^>1,  and  let  G(Gi)  and  G{Uj)  be  any  two  of  the  k 
given  distinct  elite  cliques.  Assume  for  contradiction  that  G,-  n  Uj  Tt.  0,  Then,  for  any  vertex  u  in  the 
set  Gj  n  Gy  we  have  tfeggU  >  1  G,  |-1  +  |  Gy-(G,-  H  Gy)|>|  G,- 1-1  since  Uj .  This,  however,  is  a 

coi  "adiction  since  every  vertex  u  in  the  elite  clique  G(Ui)  satisfies  degQU-\Ui\-^-  Thus,  Uir\Uj=0, 
for  all  i,  j=l,  ....  k.  Let  u,  be  any  vertex  in  G(G,)  and  let  uj  be  any  vertex  in  G{Uj)-  Assume 
for  contradiction  that  (m,  ,  uj)  G  E.  Since  G(Ui)  is  an  elite  clique  we  have  deg^Ui  =degQ(^u)Uj  and 
so  every  edge  incident  with  m,  must  be  in  G{Ui)-  This  means  that  the  vertex  uj  is  in  the  clique 
GiUi),  and  so  we  have  a  contradiction  since  UinUj=0-  Hence  (u,  ,Uj)  g?  E,  and  the  proof  of  state¬ 
ment  (a)  is  complete. 

(b)  By  statement  (a)  no  vertex  in  any  elite  clique  G(Gi)  is  adjacent  to  any  vertex  in  another  elite 
clique  G(Uj),  and  so  we  have  statement  (b). 
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(c)  If  ^>1,  then  by  statement  (b)  the  induced  subgraph  G(U  *iG,)  is  a  disconnected  graph,  and 
so  the  vertex  set  K-Uf  jG,  is  a  separator  of  G.  This  completes  the  proof. 

□ 

By  statement  (b)  in  Theorem  2,  every  set  of  elite  cliques  in  a  graph  is  an  independent  cliques  set, 
and  in  view  of  this  property  of  elite  cliques  we  introduce  the  following  definition. 


For  any  set  of  elite  cliques  Ic  in  G,  we  call  Ic  an  elite  cliques  set.  Also,  an  elite  cliques  set  of 
maximum  size  is  called  a  maximum  elite  cliques  set. 


An  interesting  property  of  a  maximum  elite  cliques  set  is  presented  in  the  next  result. 


Lemma  3.  A  maximum  elite  cliques  set  in  G=(V,E)  is  unique. 


Proof 


Let  Ic  be  any  maximum  elite  cliques  set  in  G.  If  Ic  is  the  empty  set,  we  have  nothing  to  prove. 
Suppose  Ic  ^  0<  and  assume  for  contradiction  that  there  exists  in  G  another  maximum  independent 
elite  cliques  set  such  that  Ic  ^  Ic  ■  By  statement  (b)  in  Theorem  2,  however,  no  two  elite  cliques  in 
G  have  a  common  vertex.  Thus,  Ic  must  equal  Ic  ■  This  establishes  a  contradiction  and  completes  the 
proof. 

□ 

Other  interesting  properties  of  elite  cliques  are  summarized  in  the  following  series  of  results. 

Lemma  4.  For  every  elite  clique  C(U)  in  G=(V,E),  there  exists  exactly  one  maximal  clique  G(G')  in 
G  such  that  GCG' . 

Proof 


Assume  for  contradiction  that  there  is  in  G  a  second  clique  G{U")  with  U"  ^  U'  such  that  UQU" . 
Then,  for  any  vertex  u  in  the  set  U  we  have  degQU>\U'\-\^\V" -{U'  n  G")|>|G'|-1  since  U'^U" . 
This,  however,  is  a  contradiction  since  every  vertex  u  in  the  elite  clique  G(G)  satisfies  degQU=\ll‘  \-\y 
and  so  the  proof  is  complete. 

□ 

Lemma  5.  Let  G(V)  be  any  maximal  clique  in  G=(y,E)  such  that 

int{U)  -  0  . 

Then,  no  subgraph  of  G(U)  forms  part  of  any  elite  clique  in  G. 

Proof 


Since  the  clique  G(U)  is  maximal,  G(U)  can  never  be  a  proper  subgraph  of  any  clique  in  G. 

Thus,  G(G)  can  never  be  an  elite  clique  in  G  since  degQU>\U\-\,  for  all  u  E  U.  Assume  for  contra¬ 
diction  that  U  contains  a  proper  subset  W  such  that  G(G')  is  an  elite  clique  in  G.  Thus,  there  exists 
in  G  a  clique  G{W)  such  that  U'=int{W).  Also,  since  degQU>\U\-\,  for  all  u  E  U,  and  dt?^G«=|VV"|-l, 
for  all  u  E  U' ,  we  get  |W|  >  |Gl  and  so  G(G')  is  a  proper  .subgraph  of  G(W).  Now  one  of  the  follow¬ 
ing  two  cases  must  hold. 

Case  1.  U-U’  is  a  subset  of  W.  Then  G{U)  is  a  proper  subgraph  of  G(VT)  since  U'  d  W  and 
|VV'|>1G|.  This,  however,  is  a  contradiction  since  G{U)  is  a  maximal  clique  in  G. 

Case  2.  U-U'  is  not  a  subset  of  W.  Let  u  be  any  vertex  in  U' ,  and  let  v  be  any  vertex  in 
U-U'-W.  Clearly,  the  edge  (u.v)  is  in  G  but  not  in  G(VV)  since  both  u  and  v  are  in  the  clique  G{U) 
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and  V  ^  W.  However  since  degQU-\\V\-\,  every  edge  incident  with  «  in  C  must  be  in  G(W)  and  a 
contradiction.  This  complete  the  proof. 

□ 

Lemma  6.  Let  G{U)  be  any  clique  in  G.  Then  for  any  vertex  u  in  int{U),  the  following  statements 
are  true. 

(a)  There  exists  in  G  a  maximum  independent  set  S  with  u  G  S. 

(b)  There  exists  in  G  a  minimum  feedback  vertex  set  F  with  U-{u}  C  F. 

Proof 

If  int{U)=(Z),  there  is  nothing  to  prove.  Suppose  int{U)  0,  and  let  u  be  any  vertex  in  ini(U). 
Then,  by  the  property  of  int{U)  we  have  adj^ju-U-{u}  ai.d  so  we  get 

degQU  =  \adjGu\  , 

But  Kevorkian  (1980)  has  already  shown  (Lemma  i  and  Theorem  1)  that  both  statements  (a) 
and  (b)  hold  if  the  above  relation  is  satisfied.  With  this,  the  proof  of  Lemma  6  is  complete. 

D 

BORDERED  BLOCK  DIAGONAL  MATRICES 

Theorem  2  provides  a  worthwhile  matrix  theoretic  interpretation.  Let  G={V,E)  be  the  graph  of  an 
n  by  n  structurally  symmetric  matrbt  M.  Let  /c={G((/,)|  (=1.  •••.  k.}  be  any  independent  cliques  set  in 
G  such  that  Ui  is  a  proper  subset  of  V,  and  let  An  be  a  subma.rix  of  M  such  that  the  clique 

G{Uj)  is  the  graph  of  A„-  for  /=1,  ..  ,  k.  Then,  by  statement  (b)  in  Theorem  2,  there  exists  a  per¬ 
mutation  matrix  P  such  that  PMP^  is  a  (k+J)  by  {k+I)  block  matrix  of  the  following  form 

All  Bi 

A22  Bi 

Alik  Bk 

C,  Cz  ■  ■  ■  Ck  D 

.Matrices  having  the  block  form  of  PMP^  are  called  bordered  block  diagonal  matrices.  In  the  case 
that  is  an  independent  elite  cliques  set,  we  will  refer  to  PMP^  as  a  bordered  block  diagonal  matrix 
with  respect  to  an  elite  cliques  set.  If  each  of  the  k  cliques  in  any  independent  cliques  set  consists 
of  a  single  vertex,  then  each  of  the  k  diagonal  blocks  A„  in  PMP^  is  a  1  by  1  nonzero  matrbc.  This 
special  case  of  PMP^  is  called  a  bordered  diagonal  matrix.  Bordered  block  diagonal  matrices  have 
been  u'^ed  extensively  by  researchers  Branin,  1975;  Chua  and  Chen,  1976;  and  Erisman,  1973,  in  the 
analysis  of  electrical  circuits  and  in  the  solution  of  the  equations  deriving  from  these  circuits.  The 
origins  of  bordered  block  diagonal  matrices,  however,  can  be  traced  to  the  early  works  of  Gabriel 
Kron  (1958). 
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Let  A  be  the  k  by  k  block  diagonal  matrix 


and  let  B  and  C  be  the  1  by  ^  and  ii:  by  1  block  matrices 

[B,  B2  ...  Bkf 
and 

[C,  C2  ...  Ck\  . 

Also,  let  rij  denote  the  order  of  the  the  ith  diagonal  block  in  A,  and  let  s  denote  the  order  of  the 
diagonal  block  D.  Since  permutation  matrices  are  orthogonal,  the  system  of  equations  Mx=b 

is  equivalent  to  the  following  system 

{Px)  =  (Pb)  .  (1) 


Now,  let  the  vectors  Px  and  Pb  be  partitioned  as  follows: 


where  y  and  u  are  n-s  vectors  and  z  and  v  are  5  vectors.  Also,  let  the  vectors  y  and  u  be  further  par¬ 
titioned  as  follows: 


where  y,  and  u,  are  n-,  vectors,  for  f=l,  ....  k.  Assuming  now  that  A  i-  vonsingular,  the  application 
of  generalized  Gaussian  elimination  to  (1)  results  in  the  following  special  block  upper  triangular  system 


Thus,  using  the  bordered  block  diagonal  matrix  PMP^,  the  system  of  equations  Mx=b  is  reduced 
to  the  following  equivalent  system  of  equations 

{D-CA-^B)z  =  v-CA-'u,  i=\ . k  .  (2) 

yi  =  «/  -  BjZ  , 

If  the  Schur  complement  D-CA'^  B  is  sparse,  the  entire  process  can  be  repeated  by  setting  the 
matrix  M  to  D-C  A''  B  and  the  vectors  x  and  b  lo  z  and  v-CA"'  u  respectively.  This  process  is  re¬ 
peated  until  the  Schur  complement  has  no  worthwhile  sparsity  to  exploit. 
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Hence,  from  the  viewpoint  of  solving  a  large  sparse  system  of  linear  equations,  the  efficient  com¬ 
putation  of  the  Schur  complement  D-CA~^  B  and  preserving  the  sparsity  of  the  Schur  complement  are 
two  central  issues  in  the  construction  of  a  bordered  block  diagonal  matrix. 


A  BLOCK  ALGORITHM  FOR  SYMMETRIC  LINEAR  SYSTEMS  OF  EQUATIONS 


We  first  consider  the  most  general  case  among  symmetric  matrices  and  that  is  when  M  is  structur¬ 
ally  symmetric.  Subsequently,  we  deal  with  the  more  special  case  where  Af  is  a  symmetric  matrix.  Our 
main  assumption  here  is  that  the  k  by  k  block  diagonal  matrix  A  in  PMP^  is  nonsingular.  When  this 
assumption  is  satisfied,  we  can  factor  A  into  the  product  form 

A=LU 

in  which  Z,  is  a  unit  triangular  matrix  and  U  is  an  upper  triangular  matrix  with  nonzero  diagonal 
entries. 

Let  X  and  Y  be  any  two  matrices  with  the  same  dimensions  as  the  blocks  B  and  C  in  PMP^ 
respectively.  If  X  and  Y  satisfy  the  following  triangular  systems  with  multiple  right-hand  sides 


and 


LX  =  B 


YU  =  C  , 


then  it  is  easy  to  show  that  PMP‘  can  be  factored  into  the  following  block  product  form 


PMP'^  = 


'l  o' 

'u  X 

Y  / 

0  D-YX 

(3) 


in  which  /  is  an  s  by  5  identity  matrix  and  the  O’s  are  zero  matrices.  The  matrbc  D-YX  is  the  familiar 
Schur  complement  D-CA'^B. 


With  this  block  formulation,  the  computation  of  the  Schur  complement  D~YX  takes  the  following  algo¬ 
rithmic  form. 


procedure  SCHUR: 
begin 

1.  Factorize  the  diagonal  block  An  of  A  into  the  product  form 

Ajj  =  LjjUji  ,  i  =  k  , 

where  is  a  unit  lower  triangular  matrix  and  Ujj  is  an  upper  triangular  matrix. 

2.  Solve  the  triangular  systems  with  multiple  right-hand  sides 

L„X;  =  Bj  and  YiUn  =  Cj  ,  i  =  \ . k  , 

where  the  matrices  Xj  and  F,  have  dimensions  of  B^  and  Cj  respectively; 

3.  Compute  the  Schur  complement 

D-CA-'B  =  D-Y,l,YiXi 

end 


The  computation  presented  in  procedure  Schur  can  be  tailored  to  take  full  advantage  of  both  the 
vector  and  parallel  capabilities  of  high-performance  computers.  To  begin  with,  the  k  square  symmetric 
matrices  A, ,,•••,  A**  are  factored  (a  Level  2  BLAS  operation)  in  parallel  using  any  parallel  machine 
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with  multiple  instruction  stream— multiple  data  stream  (MIMD)  taxonomy.  Next  a  total  of  2k  triangu¬ 
lar  systems  with  multiple  right-hand  sides  L^^X^  =  5,,...,  and  =  C,,...,  )^*t/**  =  C*  are 

solved  (a  Level  3  BLAS  operation)  in  parallel.  Since  the  A,-,  ’s  are  full  matrices,  factors  Ln,..., 
and  Uii,...,  Ukk  are  full  triangular  matrices  and  so  the  routines  in  the  portable  numerical  linear 
algebra  library  LAPACK  Anderson,  et  al.  (1990)  can  be  nicely  used  to  do  both  steps  1  and  2  of  the 
procedure  Schur.  At  this  point,  the  matrices  X,,...,  X*  and  Xj,...,  are  available,  and  so  the  Schur 
complement  D-C  B=D-YX  is  computed  using  matrix-matrix  multiplications  (yet  another  Level  3 
BLAS  operation). 

The  decomposition  in  (2)  not  only  requires  the  computation  of  the  Schur  complement  D-C  B 
but  also  the  term  v-CA'^u.  However,  it  we  let  vv,  be  a  vector  for  the  same  size  as  u,  and  replace  the 
triangular  system  L,;X,  =  B,  in  step  2  of  the  procedure  Schur  by 

vv,]  =  (B,  u,]  , 

the  the  term  v-CA"'u  on  the  right-hand  side  of  the  first  equation  in  (2)  can  be  written  as 

v-Ca-'B  =  D-^*,  r,w, 

Thus,  if  we  augment  the  blocks  D  and  B  with  the  vectors  v  and  u  respectively. 


D=[Dvj  and  B  =  [B  m] 

and  let 

Xj  =  [X,-  w,)  ,  /  =  1, , 

then  the  computation  of  D-CA"'  B  and  v-CA"’  u  can  be  combined  computing  the  following  aug¬ 
mented  Schur  complement 

D-CA-'B  =  D-^*,  r,  X, 

We  now  turn  our  attention  to  the  special  case  where  M  is  a  symmetric  matrix.  Then  we  have 

which  means  the  blocks  Y  and  X  are  related  through  the  following  relation 

Y=X^  . 


Thus,  in  the  case  the  matrix  M  is  symmetric  we  obtain  the  following  simplified  factored  form  for 
PMP'^. 


PMpY  = 


'  L  0 

'u  X 

X^  / 

0  D-X^X 

This  factorization  reduces  the  amount  of  computations  performed  in  the  procedure  Schur  since  in 
this  particular  case,  step  2  of  Schur  involves  the  solution  of  k  triangular  systems  of  equations  with  mul¬ 
tiple  right-hand  sides  compared  to  the  2k  required  in  the  previous  more  general  case. 


The  factorization  in  step  1  of  the  procedure  Schur  in  both  cases  considered  above  assumes  that 
each  of  the  diagonal  blocks  of  A  is  well-conditioned  and  so  pivoting  is  unnecessary.  However,  if  any 
diagonal  block  A,i  in  A  is  ill-conditioned,  then  pivoting  becomes  essential,  and  in  such  case,  the  fac¬ 
torization  in  step  1  ol  the  procedure  Schur  takes  the  following  product  form 


B,  Ajj  —  Lj  Ujj  , 


/  =  1,  , 


where  L/,  is  a  unit  lower  triangular  matrix,  (/„■  is  an  upper  triangular  matrix  with  nonzero  diagonal 
elements,  and  B,  is  a  permutation  matrix  (allows  the  necessary  row  interchanges  needed  for  pivoting). 


SPARSITY  CONSIDERATIONS  IN  PMP'^ 

With  the  derivation  of  the  block,  factorization  (3),  we  next  focus  our  attention  on  sparsity  issues 
relating  to  the  construction  of  a  bordered  block  diagonal  matrix.  But  first,  we  need  some  notation  that 
models  the  locations  of  the  nonzero  elements  of  a  matrix. 

For  any  square  or  nonsquare  matrix  X=[  jt^  ],  the  sparsity  set  of  X  is  defined  by 

5(A:)  =  {(i,j)\xij  ^  0}  . 

Thus,  two  matrices  X  and  Y  with  identical  dimensions  have  the  same  sparsity  set,  that  is, 

S(X)=S(Y)  if  and  only  if  X  and  Y  have  identical  zero-nonzero  structure.  When  X  is  square  and  sym¬ 
metric  and  the  condition  i  is  imposed  in  the  definition  of  S(X),  the  sparsity  set  S(X)  and  the  non¬ 
zero  structure  set  Nonz(XJ  introduced  by  George  and  Liu  (1986)  are  identical.  Worth  noting  is  that  if 
X  is  a  p  by  ^  matrix  and  the  vertices  of  the  two  vertex  sets  in  the  bipartite  graph  of  X  are  labeled  1, 
2,...,  p  and  1,  2,...,  q,  then  the  sparsity  set  of  X  is  precisely  the  edge  set  in  the  bipartite  graph  of  X. 

By  the  block  factorization  given  in  (3),  it  is  clear  that  the  ideal  bordered  block  diagonal  matrix 
from  the  viewpoint  of  preserving  sparsity  in  Gaussian  elimination  is  the  one  that  addresses  the  sparsity 
of  the  blocks  L,  U,  X,  Y,  and  the  Schur  complement  D-YX.  As  we  shall  show  in  the  following  result, 
a  bordered  block  diagonal  matrix  with  respect  to  any  elite  cliques  set  addresses  all  these  sparsity  issues 
to  the  fullest. 

Theorem  3.  Let  M  be  any  structurally  symmetric  matrix  and  let  G  be  the  graph  of  M.  Let  P  be  any 
permutation  matrix  such  that  PMP^  is  a  bordered  block  diagonal  matrix  with  respect  to  an  elite 
cliques  set  4  in  G.  Then  the  following  statements  are  true. 

(a)  S(L)  U  S(U)  C  5(A) 

(b)  5(X)  C  5(B) 

(c)  SiY)  C  5(C) 

(d)  5(D-KX)  C  5(D)  . 

Proof 

(a)  Let  G=(V,E)  be  the  graph  of  PMP^.  Let  G(  t/,-) .  G{Uk)  be  the  elite  cliques  in  Ic  and 

such  that  G(  Ui)  is  the  graph  of  the  block  A,-,-  in  A,  for  /=1,...,  k.  Let  C(  f/,)  be  any  element  of  Ic  ■ 
Since  G(  t/,)  is  a  clique,  the  block  A,/  is  a  matrix  with  all  nonzero  entries.  Thus,  5(L,i)  U  S((/,-,)  C 
5(A,;)  ,  for  /=!,...,  k,  and  so  the  proof  of  (a)  is  complete.  The  remaining  statements  (b)  and  (d)  fol¬ 
low  immediately  from  Theorem  1. 

□ 

If  exact  cancellation  does  not  occur,  equality  holds  in  each  of  the  three  statements  in  Theorem  3. 

As  Ortega  and  Voight  (1985)  elucidate  in  their  elegant  monograph,  there  are  two  well-known 
methods  in  computational  science  that  lead  to  structured  matrices  that  have  the  bordered  block  diago¬ 
nal  form.  These  are  the  substructuring  techniques  (Noor,  Kamel,  &  Fulton,  1978)  popularized  by 
structural  engineers,  and  the  incomplete  nested  dissection  (George,  Pool,  &  Voight,  1978).  The  results 
presented  in  this  section  and  especially  Theorem  3,  complement  the  findings  in  (George,  Pool,  & 
Voight,  1978)  and  (Noor,  Kamel,  &  Fulton,  1978),  and  hopefully  shed  some  newer  insights  into  these 
methods. 
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AN  ILLUSTRATIVE  EXAMPLE 


Consider  the  10-vertex  graph  G-(V,E)  shown  in  figure  1  and  suppose  we  wish  to  use  the  mini¬ 
mum  degree  algorithm  for  finding  an  ordering  a  of  the  vertices  in  the  set  V.  Since  degQV^=2  and 
degQV>2  for  any  v  G  we  get  a(l)=  and  so  the  a(l)-elimination  graph  takes  the  form 

Gc^d)  =(V-a{(l)},  ^(^-{aCl)})  U  def(jOL{\))  where  rfe/ca(l)={(  Vj,  v-^ )}.  Hence,  any  application  of 
the  minimum  degree  algorithm  to  the  graph  G  will  definitely  create  a  fill  element  in  the  Cholesky  fac¬ 
torization  of  the  matrix  corresponding  to  G  since  defQOi(l)^  (Z)- 


Figure  1.  Ten-vertex  graph  G-(V,E). 


Next,  we  use  the  concept  of  elite  cliques  for  finding  an  ordering  of  the  vertices  in  the  set  V.  Let 
V,  =  {v,,  Vj,  V3,  V4,  V5}  and  Vj  =  {v^,  Vg,  v,,  v,o}.  Then,  it  is  easy  to  see  from  figure  1  that  the  induced 
subgraphs  G(V^)  and  GiV^}  are  cliques  in  G  and  that 

inc{V^)  =  T,  -  {V5}  and  intiV^)  =  V^-  {v,) 

Thus,  the  subgraphs  induced  by  the  vertex  sets 

U^=int{V^)  and  U2  =  inl(V^) 

are  elite  cliques  in  G  and  so  by  Theorem  1  both  G(G,  )  and  GiU^ )  are  perfect  elimination  cliques. 
Therefore,  if  we  let  a  be  any  ordering  of  the  vertices  in  the  .set  G=G,  u  v,,  v^,  Vj,  v^,  Vg,  v,,  v,q  }, 
then  the  a-elimination  graph  G\„\  =G-j  consists  of  the  induced  subgraph  G(V-U),  that  is  G-,-G(V-U). 
Since  the  induced  subgraph  G(V-U)  consists  of  the  path  (v5,Vg),  (vj,V3),  it  is  now  easy  to  verify  that 
the  use  of  the  concept  of  elite  cliques  leads  to  a  Cholesky  factorization  that  does  not  suffer  any  fill. 


13 


THE  CORE  OF  A  CLIQUE  AND  MAIN  RESULTS 


We  begin  by  introducing  the  concept  of  the  core  of  a  clique.  This  concept  will  subsequently  be 
used  to  derive  key  results  on  the  construction  of  elite  cliques. 

For  a  clique  G{U)  in  the  graph  G=(y,E),  the  core  of  G{U)  is  the  vertex  set  cor{U)  defined  by 

cor{U)  =  {u  G  L'  I  degQU  -  min  degQv}  . 

V  e  U 

The  concept  of  the  core  of  a  clique  is  a  natural  extension  of  the  concept  of  the  interior  of  a 
clique.  To  see  this,  we  first  express  the  vertex  set  int(U)  in  the  following  form 

int{U)  =  {u  G  f/  I  deggu  =  |f/|  -  1}  . 

Comparison  of  these  two  expressions  reveals  that 

int(U)  -  cor(U) 

if  and  only  if 

min  degQU  =  |t/|  -  1  . 
u  E.  U 

The  fundamental  property  of  the  core  of  a  clique  is  highlighted  in  the  next  result. 

Theorem  4.  Let  G{Ui),  ....  G{Ur)  be  any  clique  partition  of  the  graph  G=^(V,E).  Then,  for  any  elite 
clique  G(U)  in  G,  the  following  statements  are  true. 

(a)  G  C  (J  cor{Ui) 

(b)  If  G  n  cor(Ui)  9*  0,  for  any  /  =  1,...,  r  then  cor{Ui)  C  U  . 

Proof 


(a)  Assume  for  contradiction  that  statement  (a)  does  not  hold.  Then,  we  have 
Ur\{Ui-cor{Ui))  ^  0  for  some  /=1,  ...,  r  since  the  Uj’s  form  a  partition  of  the  vertex  set  V'  in  G. 
Since  G(U)  is  an  elite  clique,  there  exists  in  G  a  clique  G(C)  such  that  U=int(C)  and  so  for  any 
vertex  u  of  UnUi,  we  have  adjQU=C-{u}.  But  we  also  have  G/-{m}  C  adj^u  since  uG  {/,  and  G{Ui) 
is  a  clique,  and  so  we  obtain  G,  C  C.  Now  let  v  be  any  vertex  of  cor(  U,).  Then,  by  the  property  of 
cor{Ui)  we  have  degQV<degQW  for  any  w  G  Ui-cor(Ui).  Thus,  for  any  vertex  u  of  Gn(  G,— cor(  G;)) 
we  get  deg^v  <  deg^u.  But  we  know  that  degQU  <degQ\v  for  all  w  G  C  since  u  E.  U  and  G(G)  is  an 
elite  clique.  Consequently,  we  obtain  deg^u^  deg^v  since  v  G  C  and  a  contradiction.  This  completes 
the  proof  of  statement  (a). 

(b)  Let  u  be  any  vertex  of  Ur\cor{Uj)  and  let  v  be  any  vertex  of  cor[lJi)-U.  Then,  we  have 
deg^u-deg^v  since  both  u  and  v  are  vertices  of  cor{(j.).  Also,  since  UjQC  we  have  cor(C/;)£C  and 
so  both  u  and  v  are  vertices  of  C.  As  a  result,  we  obtain  degQU<degQV  since  u  G  G  and  v  ^  G.  This 
establishes  a  contradiction  and  completes  the  proof. 

□ 

Theorem  4  provides  a  number  of  worthwhile  results  and  algorithms. 
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Corollary  4.1.  The  following  two  siatemenis  are  equivalent. 

(a)  /(,  is  an  elite  cliques  set  in  G. 

(b)  is  an  elite  cliques  set  in  G(  C£>/-(t/,)  )• 

Proof 

This  is  an  immediate  consequence  of  statement  (a)  in  Theorem  4. 

□ 

By  statement  (a)  in  Theorem  4  or  Corollary  4.1,  the  vertex  set  T  in  a  graph  G  is  partitioned  into 
two  disjoint  sets 

r 

r  =  U  cor(f/,)  , 

i  =  I 

and 

r 

=  T-  U  cor(t/,)  . 

;  =  I 

such  that  every  elite  clique  in  G  is  a  subgraph  of  G(V").  This  partitioning  of  G  into  two  subgraphs 
G(V’')  and  G(V")  has  a  worthwhile  matrix  theoretic  interpretation.  In  particular,  if  the  matrix  A  corre¬ 
sponding  to  the  graph  G  has  decoupled  blocks  that  can  be  factored  in  parallel  and  without  giving  rise 
to  any  fill  element,  then  by  Corollary  4.1  the  vertices  representing  the  rows  of  these  decoupled  blocks 
are  fully  contained  in  the  induced  subgraph  G(V"). 

As  an  illustration,  consider  the  11-vertex  graph  G=(V,E)  shown  in  figure  2.  Looking  at  figure  2, 
we  can  easily  see  that  the  .subgraphs  induced  by  the  vertex  sets 

Cl  =  {V,.V2,V3,V,} 

^2  =  {vs.Vv?} 

^4  ~  t^’lD’^’ll^ 

form  a  clique  partition  of  the  graph  G. 

Also  it  can  be  readily  verified  that 

degfV2  <  deg^Vi  ,  /=  1,3,4  , 

degfVs  =  deg(.V2  <  deg^^Vf,  , 
degfjVg  ■--  deg^v^  . 

degff^o  =  degf^v^^  , 

and  so  by  the  construction  of  the  core  of  a  clique  in  G  we  obtain 

corfC,)  ^  {vj}  , 
coriU^)  =  {vj.v.}. 

cor(Uy)  =  {vr,  V,)  , 
cor(l\)  =  {I'lo.Vi,}  . 

Since  deg(-v^-\U’^\-\,  we  have  cor(^(j^)=mt(lj\)  which  means  G{cor{Ux))  is  an  elite  clique  in  G. 
Furthermore,  if  we  let  W  =  {v’4' ^’5- ^lO’ ^’iJ’  verify  that  G{U)  is  a  clique  in  G  with 

ini(U)  =  {  V|f|,V|,  This  means  that  the  induced  subgraph  G{cor{(j^))  is  also  an  elite  clique  in  G. 
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That  G(cor{Ui))  and  G(cor{U^))  are  the  only  two  elite  cliques  in  G  can  be  verified  by  applying 
Lemma  4.  Let  U'  =  {v,,  Vj,  Vj,  vj ,  U"  =  {v^,  Vj,  v^,,  v,}  and  U’"  =  {vg,  Vg.  vj  ■  Then,  it  is  easy  to  verify 
that  each  of  the  induced  subgraphs  G{U‘),  ....  G(U'")  is  a  maximal  clique  in  G,  and  that 

int(U')  =  int{U")  =  int(U'")  =  0. 


Figure  2.  Eleven-vertex  graph  C=(V',£). 


So,  by  the  application  of  Lemma  5  it  follows  that  no  vertex  in  the  set 

U'  U  G"U  U'"  =  {v,,V3,v^,  Vj.v^,  V7,Vg,  V,}  =  V -  cor(U^)  -  cor{U^) 

is  contained  in  an  elite  clique  in  C.  This  completes  the  illustration  of  statements  (a)  and  (b)  in 
Theorem  4  as  well  as  Corollary  4.1. 

The  next  corollary  to  Theorem  4  has  an  efficient  algorithmic  interpretation. 

Corollary  4.2.  Let  (v,w)  be  any  edge  in  the  graph  G={V,E)  such  that 

degfyv  <  deggv/. 

Then,  the  vertex  w  can  never  be  in  any  elite  clique  in  C. 

Proof 

Let  (/i={v,w}.  Then,  G(Uj)  is  clique  in  G  since  (v,h')  G  E,  and  so  for  any  clique  partition 
GiUz),---,  G(Ur)  of  the  induced  subgraph  G(y-V\)  the  cliques  G((/i),...,  G{Ur)  for™  a  clique 
partition  of  G.  Now  by  the  hypothesis  of  the  corollary  we  have  degQV  <  deg^w,  which  means  that 
w  ^  cor(  U\)  and  so  by  statement  (a)  of  Theorem  4  the  vertex  w  can  never  be  in  an  elite  clique  in 
G.  This  completes  the  proof. 

□ 
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Corollary  4.2  suggests  the  following  way  of  visiting  the  vertices  of  a  graph  G={V,E).  We  select  and 
“visit"  a  starting  vertex  v.  Then,  for  each  unexplored  edge  (v',w)  incident  with  v  we  apply  Corollary 
4.2.  If  degQV=degQW,  we  pick  the  next  unexplored  edge  incident  with  v  since  Corollary  4.2  does  not 
apply.  If  deg^■v^degQW,  then  either  degfjV<degQW  or  degQW<degQV.  If  the  former  holds,  we  mark  w 
as  a  vertex  that  can  never  be  in  an  elite  clique,  and  if  the  latter  holds,  we  mark  v.  Once  all 
unexplored  edges  incident  with  v  have  been  considered,  we  pick  the  next  unvisited  vertex  in  G  and 
repeat  the  steps  we  took  at  the  starting  vertex  until  all  vertices  in  G  have  been  visited.  We  will  call 
this  method  of  visiting  the  vertices  of  an  undirected  graph  an  elite  search  since  such  a  search  of  an 
undirected  graph  G={V.E)  partitions  the  vertex  set  V  into  two  disjoint  sets  R  and  S  so  that  all  elite 
cliques  in  G  are  subgraphs  of  the  induced  subgraph  G{R). 

A  procedure  for  elite  search  in  a  pseudo-Algol  language  adopted  by  Aho,  Hopcroft  and  Ullman 
(1976)  is  presented  next.  The  input  for  the  procedure  is  an  undirected  graph  G=(V,E)  represented  by 
adjacency  lists  Z,[v]  for  all  v  G  V.  We  assume  that  each  vertex  v  in  V  is  marked  “new”  and  T[v]=0. 
Also  we  assume  that  the  vertex  sets  R  and  5  are  initially  set  to  the  empty  set. 

procedure  SEARCH: 

begin 

while  there  exists  a  vertex  v  in  V  marked  “new”  do 
begin 

mark  v  “old”; 

for  each  vertex  w  on  L|v]  do 
if  w  is  marked  “new”  then 
if  D£G(vi  DEG\w]  then 

if  D£Glv)<Z)£G(w)  then  £[w]  ^  1 
else  £[vl  1 

end; 

for  all  V  in  V  do 

if  £lv  l=0  then 

begin 

mark  v  “new”; 
add  V  to  R 

end 

else  add  v  to 

end 

An  elite  search  of  the  graph  G={V,E)  partitions  the  vertices  in  V  into  two  sets  R  and  S  such  that 
S={vv  I  there  exists  in  G  an  edge  (v,w)  such  that  degQ\'<degf^w). 

By  Corollary  4.2,  this  means  that  every  elite  clique  in  C  is  a  subgraph  of  G{R). 

Initially,  all  vertices  in  G  are  marked  “new.”  We  associate  with  each  vertex  v  in  G  a  nonnegative 
integer  D£G[v|  representing  the  degree  of  v  in  C  and  a  Boolean  integer  £[v].  Initially,  all  these 
Boolean  integers  are  set  to  zero.  At  the  completion  of  the  while  loop  in  SEARCH,  a  Boolean  integer 
£[v'|  takes  the  value  of  1  if  and  only  if  for  some  unexplored  edge  (v,w)  in  £  the  vertices  v  and  w 
satisfy  the  inequality  D£Glvv|<D£G[v| .  By  Corollary  4,2,  this  means  that  each  vertex  v  in  G  that  can 
never  be  in  an  elite  clique  in  G  will  have  £[v|  =  l. 

Suppose  we  apply  the  procedure  SEARCH  to  the  graph  G  in  figure  2.  Initially,  all  vertices  in  G 
are  marked  “new.”  Suppose  the  vertices  v,,  Vj, v,,  are  visited  in  that  order.  We  select  v,  and  mark 


17 


it  “old.”  The  unexplored  edges  incident  with  v,  are  (v’i’'’2).  ( '  i- V3),(  v,,  V4),(Vj,  v^)  and  (v,,v,). 
Now  since 

deggVj  <  deg^v,  , 
deggv,  <  deg^V4  . 
deg^v,  <  deg^-Vft  , 

the  procedure  SEARCH  sets  f(V|  |=/^|  |=F[  1=1.  Next,  vertex  is  visited  and  marked  “old.”  The 

edges  incident  with  Vj  are  (v^.v,),  (Vj.Vj),  and  (v^,  v^).  The  edge  (vj.v,)  has  already  been  explored 
and  will  not  be  considered  further  since  the  vertex  v,  is  marked  “old.”  The  remaining  two  edges  are 
presently  unexplored  and  so  the  procedure  SEARCH  sets  FlvjHl  since  degQV2<degQVy.  Next,  Vj  is 
visited  and  marked  “old.”  The  unexplored  edges  incident  with  Vj  are  (vj.v^),  (vj,  Vg)  and  (vj.v,). 
However,  since  degQ  Vj=degQV^  and  1=/^|  Vg]  =  l,  vertex  is  visited  next  and  marked  “old.”  The 
unexplored  edges  incident  with  are  (v^.v,).  (v^.v^),  (v^.v^),  (v^.Vjo),  and  (v^.v,,).  Again,  the 
Boolean  numbers  associated  with  the  vertices  Vj,  Vg,  v,,  Vjq  ,  and  v,,  remain  unchanged  with  this  visit  of 
the  vertex  since  the  degree  at  this  vertex  is  greater  than  the  degree  of  any  adjacent  vertex.  It  can 
readily  be  verified  that  the  visits  to  the  remaining  vertices  v’s-Vg,  .  ..v,,  brings  in  the  following  changes 
F[  v'j  l=/*'[  V,  ]  =  1  in  that  order.  Thus,  at  the  completion  of  the  while  loop  we  have 


and 

which  means  that 
and 


Flv,  1  =  Flvjl  =  Flv^l  =  FIV5]  =  F(Vg]  =  F[v,]  =  1 
R  =  {vj.Vg.  v,.v,o,v,,} 

5  =  {v,.V3,V4.V5.Vg,V7}  . 


It  is  interesting  to  note  that  the  induced  subgraphs  C({v2}).  ^({vg.v,}),  and  G({  v,;,,  Vj, })  consti¬ 
tute  the  connected  components  of  G{R),  and  furthermore,  these  connected  components  are  induced 
by  the  vertex  seta  cor(Ui),  cor{U{),  and  cor(U^).  As  we  shall  show  later  on,  this  is  not  a  coincidence 
but  a  property  of  the  procedure  SEARCH. 

The  next  theorem  and  its  corollaries  highlight  the  main  properties  of  elite  search. 

Theorem  5.  Every  elite  clique  in  the  graph  G={V,E)  is  a  connected  component  of  the  induced  sub¬ 
graph  G{R). 

Proof 

Let  G{U)  be  any  elite  clique  in  G.  Let  u  be  any  vertex  in  U.  If  degQU=0,  then  there  is  no  edge 
incident  with  u  in  G.  Thus,  F[u|  =  0  at  the  completion  of  the  while  loop  in  SEARCH,  and  so  u  will 
be  in  R  at  the  completion  of  SEARCH.  Suppose  degQU>0,  and  let  (m,v)  be  any  edge  incident  with  u 
in  G.  By  the  construction  of  an  elite  clique,  there  exists  in  G  a  maximal  clique  G{U')  such  that 
l'=int(V') .  Then  either  the  vertex  v  is  in  the  set  U  or  U'-U  since  by  Lemma  4  every  elite  clique  is 
contained  in  exactly  one  maximal  clique  in  G.  If  v  is  in  U,  then  by  the  construction  of  an  elite  clique 
we  have  degQU=deg(-v  which  means  that  F(v]=0  at  the  completion  of  the  while  loop  in  SEARCH  and 
so  every  vertex  in  V  will  be  R  at  the  completion  of  SEARCH.  Suppose  v  is  in  U'-U.  Then  we  have 
U'-{v}  CZ  adjf^.v  since  v  is  a  vertex  in  the  clique  G(U')  and  v  ^  U.  This  means  that  dpgfjV>deg(jU 
since  adjc^u=U' -{u} .  Thus,  we  get  F[v)  =  l  at  the  completion  of  the  while  loop  in  SEARCH  since  (u,v) 
is  an  edge  in  G.  Hence,  (U'-U)  n  R-Q)  at  the  completion  of  SEARCH,  and  so  G{U)  must  be  a  con¬ 
nected  component  of  the  induced  subgraph  G(R).  This  complete  the  proof. 

□ 
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Corollary  5.1.  If  the  graph  G={V,E}  contains  more  than  one  elite  clique,  then  the  vertex  set 

S=V-R 

is  a  separator  of  G. 

Proof 

Suppose  G  contains  more  than  one  elite  clique.  Then,  by  Theorem  5  these  elite  cliques  are  con¬ 
tained  in  a  subgrapfi  of  G  induced  by  the  vertex  set  R=V-S,  and  so  by  statement  (b)  of  Theorem  2 
the  induced  subgraph  G{V-S)  is  a  disconnected  graph.  This  completes  the  proof. 

□ 

Corollary  5.2.  Let  G=(V,E)  be  any  connected  graph.  If  every  edge  (u,v)  in  G  satisfies 

deg^u^deg^v, 

then  one  of  the  following  two  conditions  must  hold: 

(a)  G  is  an  elite  clique. 

(b)  G  is  an  imperfect  elimination  graph. 

Proof 

Suppose  every  edge  (t/,v)  satisfies  the  hypothesis.  Then,  we  have  R-V  and  so  G(R)  consists  of 
exactly  one  connected  component  since  G  is  a  connected  graph.  Consequently,  by  Theorem  5,  either 
G  is  an  elite  clique  or  not.  If  it  is  an  elite  clique,  then  we  have  statement  (a).  Suppose  G  is  not  an 
elite  clique.  Then,  by  Theorem  5  no  part  of  G  is  an  elite  clique,  and  so  by  Theorerri  1,  no  vertex  in 
G  is  a  perfect  elimination  vertex.  This  means  that  G  is  an  imperfect  elimination  graph  [statement  (b)] 
and  as  a  result  tlie  proof  is  complete. 

□ 

The  next  lemma  establishes  a  connection  between  the  minimum  degree  algorithm  and  elite  search. 
Lemma  7.  Every  vertex  u  in  L  with 


degQU  =  min  degQV 
V  &  '/ 

is  contained  in  the  set  R. 

□ 

Proof 


Let  u  be  any  vertex  with  minimum  degree  in  G.  Then  there  exists  no  edge  (u,v)  in  G  such  that 
degGy<degQU.  This  means  that  u  can  never  be  in  the  set  S  at  the  completion  of  SEARCH.  So  the 
vertex  u  must  be  in  the  set  R  since  R  and  S  form  a  partition  of  the  vertex  set  V.  This  completes  the 
proof. 

□ 

If  every  connected  component  of  (he  induced  subgraph  G{R)  is  a  clique,  then  the  connected 
components  of  GiR)  form  an  independent  cliques  set  in  G.  By  Theorem  5,  this  particular 
independent  cliques  set  has  the  property  that  every  elite  clique  in  G  must  be  in  .  In  practice, 
however,  one  or  more  connected  components  of  G{R)  may  not  be  cliques.  Thus,  to  construct  an 
independent  cliques  set  of  G{R),  we  first  require  a  procedure  to  con.siruct  the  connected  components 


of  G{R)  and  test  each  connected  component  for  the  clique  property.  If  a  connected  component  G{U) 
of  G{R)  is  a  clique,  there  is  nothing  further  to  do.  Otherwise,  we  require  a  procedure  to  construct  an 
independent  cliques  set  in  G{U).  To  do  this,  we  need  a  procedure  to  construct  a  clique  in  G(U).  Let 
CLIQUES{U)  be  such  a  procedure  and  let  NqU  be  the  set  of  vertices  defined  by 

A'cf/  =  (  U  adJcu)  -  U  . 

u  G  U 

Let  G(U')  be  any  clique  constructed  by  the  procedure  CLIQUES{U).  Then  by  the  construction  of 
the  vertex  set  N qU  it  is  easy  to  see  that  for  any  clique  G{U")  in  G{U-U' -NqU')  the  cliques  G(f/') 
and  G{U")  form  an  independent  cliques  set  in  G{U).  Thus,  a  way  of  constructing  an  independent 
cliques  set  of  G{IJ)  is  to  recursively  construct  a  clique  G(U')-,  set  U  to  U-U'-NqU'  and  repeat  these 
two  steps  until  U  is  the  empty  set. 

The  procedure  SEARCH  combined  with  a  procedure  COMPONENT  for  constructing  connected 
components  of  a  graph  as  well  as  the  procedure  CLIQUES  gives  rise  to  a  procedure  ICS  (independent 
cliques  set)  for  finding  an  independent  cliques  set  in  an  undirected  graph  G-(V,E).  We  assume  that 
the  input  graph  G  is  not  a  clique. 


procedure  ICS{\'): 
begin 

^  0; 

S  ^  0; 

for  all  V  in  V  do 
begin 

mark  v  ’’new”  ; 

F[vl  ^  0 
end; 

SEARCH; 

NUM EDGES  4-  0; 

t/  4-  0; 

while  there  exists  a  vertex  v  in  marked  “new"  do 
begin 

COMPONENTiv)-. 

if  NUMEDGES^\U\  X  (\U\-l)  then 
CLIQUES(U) 

end 

end 


procedure  COMPONENT{v): 
begin 

mark  v  “old”; 
add  V  to  U; 

for  each  vertex  w  on  L[v]  do 
if  F[w]=0  then 
begin 

NUMEDGES  4-  NUM  EDGES  +  1 ; 
if  w  is  marked  “new”  then 
COMPONENTiw) 

end 

end 
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procedure  CLIQUES(U): 

begin 

LIST  *-  0; 

for  all  li  in  C/  do  mark  u  “new”; 
while  there  exists  a  vertex  u  m  U  marked  “new”  do 
begin 

mark  u  “old”; 

for  each  v  on  L[u]  do 

if  V  is  marked  “new”  then 
begin 

add  V  to  LIST; 
f  [vl  ^  1 

end; 

while  LIST^;^  do 
begin 

select  any  vertex  v  in  LIST  and  mark  it  “old”; 
delete  v  from  LIST; 
for  each  vertex  w  on  L[v]  do 
if  w  is  marked  “new”  then 

if  F[w]  =  l  then  f[w]  * - 1; 

else 

begin 

mark  w  “old”; 
add  w  to  S; 
delete  w  from  R 

end; 

for  each  vertex  w  on  LIST  do 
if  F[w]=-i  then  F[w]  *—  1 
else 

begin 

delete  w  from  LIST; 
mark  w  “old”; 
add  w  to  5; 
delete  w  from  R 

end 


end 


end 

end 


At  the  completion  of  SEARCH  in  the  procedure  ICS,  the  vertex  -set  R  has  the  property  that  every 
elite  clique  in  G  is  a  connected  component  of  G(/?).  The  procedure  COMPONENT  constructs  the 
connected  components  of  G{R)  using  depth-first  search  (Aho,  Hopcroft,  and  Ullman,  1976).  The  in¬ 
teger  NUMEDGES  defines  the  number  of  edges  visited  by  COMPONENT  in  the  process  of  construct¬ 
ing  G{U).  Let  G{U)  be  any  connected  component  constructed  by  the  procedure  COMPONENT.  If 
G{ll)  is  a  clique,  then  we  have  |£((/) |=|(/| X (lt/|-l)/2  and  so  G(JJ)  is  a  clique  if  NUMEDGES=\II\ 
(|t/|-l)  since  depth-first  search  visits  every  edge  of  an  undirected  graph  exactly  twice.  Thus,  if 
NUMEDGES=\U\xi\U\-\),  the  procedure  ICS  proceeds  with  the  construction  of  the  next  connected 
component  of  G{R).  Otherwise,  the  procedure  CLIQUES  is  called. 

The  main  purpose  of  the  procedure  CLIQUES{U)  is  to  construct  an  independent  cliques  set  in 
G(U).  CLIQUES{U)  is  designed  so  that  each  pass  of  the  outer  while  loop  generates  one  element  of 
the  independent  cliques  set.  The  approach  adopted  for  constructing  a  maximal  clique  in  G(U)  is  as 
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follows.  We  select  any  vertex  u  in  U  marked  “new”  and  use  the  for  loop  in  the  outer  while  to 
construct  the  vertex  set  L/ST  defined  by 

LIST={v  L[ul  I  V  is  marked  “new”  and  f  [v]  =  l}. 

Let  W={u}  and  suppose  we  insert  the  statement  VV<— W  u  {v}  immediately  following  the  selection  of 
the  vertex  v  in  the  inner  while  loop  in  CL1QUES{U).  We  will  now  use  induction  to  prove  that  at  the 
completion  of  each  pass  of  the  inner  while  loop  the  set  VV  induces  a  clique  in  G{U).  Since  W={u} 
initially  and  u  is  adjacent  to  each  vertex  in  LIST,  it  follows  that  the  vertex  set  W=W  u  {v}=(u,v} 
induces  a  clique  in  G{U)  at  the  completion  of  the  first  pass  of  the  loop.  Now  assume  that  G(VV)  is  a 
clique  at  the  completion  of  the  ith  pass  of  the  loop.  Since  G{'^')  is  a  clique  and  the  vertex  v  in  W  was 
arbitrarily  chosen  at  the  ith  pass  of  the  loop,  any  vertex  u  in  the  set  VL-jv}  is  adjacent  to  every  vertex 
in  the  set  LIST.  Our  next  objective  is  to  see  which  vertices  on  Hv]  marked  “new”  are  in  LIST.  Since 
t/  is  a  subset  of  the  vertex  set  R,  by  the  construction  of  R  in  the  procedure  SEARCH  any  vertex  v 
marked  “new”  in  U  and  has  F[vl  =  l  must  be  in  LIST.  Thus  any  vertex  w  on  L[v]  marked  “new”  and 
with  F[w]  =1  must  be  iri  LIST.  The  first  for  loop  in  the  inner  while  loop  sets  each  vertex  w  marked 
“new”  on  Ljv]  and  with  E[vvl  =  l  to  have  f  [vv]=-l.  Thus,  any  vertex  w  in  U  that  has  7-’[w]=-l  is  adja¬ 
cent  to  V  as  well  as  to  every  vertex  in  the  set  W-{v}.  This  means  that  the  set  W-W  u  {w}  induces  a 
clique  in  G{V).  The  second  for  loop  in  the  inner  while  loop  modifies  LIST  so  that  each  vertex  in 
LIST  is  adjacent  to  every  vertex  in  W.  This  completes  the  proof  of  the  induction.  This  way,  the  inner 
w  hile  loop  generates  a  clique  that  is  maximal  in  the  subgraph  of  G{U)  consi.'ting  of  the  vertices 
marked  “new.” 

To  complete  the  correctness  of  the  procedure  CLIQUES{U),  we  need  to  show  that  the  cliques 
constructed  by  CLIQUES{U)  form  an  independent  cliques  set  in  G{U).  Let  G(VV)  be  any  clique  con¬ 
structed  by  the  procedure  CLIQUES(U) .  Then,  it  is  easy  to  verify  that  every  vertex  x  in  U-W  that  is 
adjacent  to  a  vertex  v  in  W  is  marked  “old”  during  the  construction  of  the  clique  G(VV)  and  hence 
never  considered  for  the  construction  of  another  clique  in  CLIQUES{U) .  Thus,  for  any  two  vertices  .r 
and  >'  in  two  different  cliques  constructed  by  CLIQVES(V),  we  have  (x,y)  ^  E{V)  and  so 
CLIQUES{U)  correctly  constructs  an  independent  cliques  set  in  G{U). 

If  X  is  the  vertex  set  produced  by  applying  the  procedure  ICS  to  the  graph  G=(V',£)  and  I^  is  the 
set  consisting  of  the  connected  components  of  the  induced  subgraph  G{R),  then  we  have  the  following 
key  properties  of  ICS. 

Theorem  6.  The  set  I^  satisfies  the  following  two  properties: 

(a)  I^  is  an  independent  cliques  set  in  G 

(b)  Every  elite  clique  in  G  is  an  element  of  1^  . 

Proof 

(a)  This  follows  immediately  from  the  proof  we  gave  for  the  correctness  of  procedure  CLIQUES. 

(b)  Let  G(U)  be  any  elite  clique  in  the  graph  G.  Then,  by  Theorem  5,  G{U)  is  a  clique  in  the 
original  induced  subgraph  G(R).  Thus,  the  procedure  CLIQUES  is  never  applied  to  G(G)  and  so  G{U) 
remains  a  connected  component  of  G{R)  at  the  completion  of  ICS.  With  this  the  proof  of  statement 
(b)  is  complete. 


Let  T  be  the  vertex  set  defined  by 

T  =  S-  Ug(,  N^V  , 

c 

where  S-V-R.  The  next  result  ignores  some  sparsity  issues  to  increase  the  size  of  the  independent 
cliques  set  constructed  in  procedure  ICS. 

Corollary  6.1.  For  any  independent  cliques  set  /  in  the  induced  subgraph  G(T),  the  set 

l'c  =  lcGi  I 

is  an  independent  cliques  set  in  G. 

Proof 

This  is  a  direct  consequence  of  Theorem  6  and  the  definition  of  the  vertex  set  T. 
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CONTRACTIONS  WITH  RESPECT  TO  AN 
INDEPENDENT  CLIQUES  SET 


Let  If.  be  any  independent  cliques  set  in  the  graph  G={V,E)  and  let  a  be  any  ordering  of  the 
vertices  in  the  set  Uott/)  e  Our  main  objective  is  to  derive  explicit  and  implicit  forms  of  the 
a-elimination  graph  G|^|.  We  begin  by  considering  a  single  clique  in  G. 

Theorem  7.  Let  G{U)  be  any  clique  in  the  graph  G=(V,E)  and  let  a  be  any  ordering  of  the  vertices 
in  U.  If  Gq-G  and  G,- =(G/ _  j)  for  la|-l,  then 

adjQ,a{k)-U  =  iadj(.^oi{k)  -  U)  U^U  “  O')  -  G)^,  =  /+l,...,la|  . 

Proof 


We  will  prove  this  by  induction  on  |a|.  Since  G(G)  is  a  clique,  we  have  (a(l),  cx(k))  G  E  for 
k=2,  |a|.  Thus,  for  any  vertex  u  in  adjQa(l)-U  we  have  adjQOi(l)-U  C  adjQ  a{k)-U  for  k=2, 

...,  |a|  and  so  we  obtain  adj^  Oi(k)-U={adj(^ot{k)-U)  u  (adjQa{l))-U)  for  j=k,  la].  Now  assume 
that  tne  elimination  graph  Gj_i  satisfies  the  above  equality,  that  is 


adj,^  Oi  (k)  ~  U 


{adjQ  oi{k)-U)  U  ^  U  “  0)  -  G)^  , 


k  =  i,.. 


a 


Now  since  G(G)  is  a  clique,  we  have  (q!(/),  a{k))  G  E  for  <:  =  /  +  1 .  |a|  and  so  for  any 

vertex  u  in  adjQ  a{i)-U  we  get  adjQ  a{i)-U  C  adjQ  a{k)-U  for  k  =  i  +  1,  ...,  |a|.  This  means  that 

^1-1  1-1  I 

adjQ,oi{k)-U  =  {adjQOi{k)-U)  \J{adjQ,  a{i)-U)  ,  k  =  /+l,...,|a|  • 

Combining  the  above  two  equalities  completes  the  proof  of  the  theorem. 

□ 

As  a  direct  consequence  of  Theorem  7  we  have  the  following  result. 


Corollary  7. 1. 


and 


Proof 


The  Q!-elimination  graph  G|jjj  =  (V'j^|,£|^j)  satisfies 


^lal  =  U(U{(v.w)})  . 

V,  w  G  NqU 


V  5^  w  . 


Let  m=lG|.  Then  |a|=m,  and  so  by  Theorem  7  we  obtain 

m 

adjQ^  ^a{m)  =  (J  {adjQ  a{J)  -  G)  , 

=  NqU. 

Hence,  by  Lemma  2  the  set  of  vertices  NqU  form  a  clique  in  the  elimination  graph  G.  This  com¬ 
pletes  the  proof  since  Gm  =  Gi^i. 
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Applying  Corollary  7.1  to  every  element  of  an  independent  cliques  set  leads' to  the  next  result. 


Corollary  7.2.  Let  be  any  independent  cliques  set  in  the  graph  G=(V,£)  and  let  a  be  any  order¬ 
ing  of  the  vertices  in  the  set  UG(f/)  e  ij-^-  Then,  the  a-elimination  graph  G|a|  =  (^|a|>^|a|)  satisfies 

U  (U  (U  {(V.W)})).  V  W. 

G(U)er  v.weN^U 
t  o 

Proof 

Since  the  elements  of  the  independent  cliques  set  are  the  connected  components  of  the  sub¬ 
graph  induced  by  the  vertex  set  ^  the  proof  follows  immediately  from  Corollary  7.1 

□ 

If  a'  and  a"  are  any  two  distinct  orderings  of  the  same  set  of  vertices  in  a  graph  G=(V,E),  then 
the  a' -elimination  graph  G|(^„|  may  not  be  the  same  as  the  a" -elimination  graph  In  sharp 

contrast  to  this,  the  a-elimination  graph  GjQ,|  for  any  ordering  a  of  the  vertices  in  the  set  UG(t/)  e 
is  unique.  Moreover,  Corollary  7.2  suggests  that  the  a-elimination  graph  G|(^|  can  be  obtained  in 
parallel. 

To  illustrate  Theorem  7  and  its  corollaries,  we  consider  the  15-vertex  graph  G=(V,E)  shown  in 
figure  3.  This  graph  is  slightly  more  challenging  than  the  one  we  considered  earlier  in  figure  2. 


Figure  3.  Fifteen-vertex  graph  G={V,E). 
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It  can  be  easily  verified  that  the  application  of  the  procedure  ICS  to  the  graph  G  produces  the 

sets 

=  {^l> '’3' ^4> '^5> ^’s’ '’lO' '’ll*  ^13’ '’hJ 

and 

S  =  V-X  -  {V2.v,.v,.v,^.v,5}  . 

There  are  five  connected  components  in  the  induced  subgraph  G{X).  The  vertex  sets  inducing 
these  five  connected  components  are 

t/i  =  {v-i)  * 

~  ^'3’  '’4’  ’ 

t/3  =  {V7,  Vg}  , 

^4  =  {''lO’''ll)  ’ 

^5  =  {‘'l3*‘'l4>  • 

From  figure  3  it  is  easy  to  see  that  each  of  the  five  connected  components  of  the  induced  sub¬ 
graph  G{X)  is  a  clique.  Furthermore,  we  can  show  that  each  of  the  three  connected  components, 
G{Ui),  GiUi)  and  G{Ui)  is  an  elite  clique  in  G.  There  are  no  other  elite  cliques  in  G.  Thus,  the 
procedure  ICS  generates  the  independent  cliques  set 

4={G(t//)  I  i=l .  5} 

that  has  the  maximum  elite  cliques  set  {G{Ui),  G{Uz),  G{Ui)}  in  G  as  its  subset. 

Since  G(Ui),  G{Ui),  and  G{Ui)  are  elite  cliques,  by  Corollary  1.1  the  elimination  of  the  vertices 
in  these  three  elite  cliques  in  any  order  will  not  create  any  fill  edge.  So  we  will  focus  our  attention  on 
the  remaining  cliques  G(U4)  and  GiU;)  in  G. 

First,  we  apply  Theorem  7  to  the  cliques  G(U^)  and  G{U^).  Let  a'=(v,(j  ,Vj,)  and  Q!"=(v,3 , Vj^) 
be  orderings  of  the  vertices  in  the  sets  and  in  G  respectively.  Since  adj^a'  {1)-U^={v^},  by 
Theorem  7  the  a' (l)-elimination  graph  G,  satisfies 

adj(^a'(2)-adjQa'{2)-U^  =  adj(^a‘{l)  -  =  {v,}  . 

Similarly,  the  a"  (l)-elimination  graph  G,  satisfies 

adjc^a"(2)-adjca"{2)-U,  =  adjca"i\)-U,  =  {v,^}  . 

Thus,  (v,  ,v,,  )  and  (vj2,v,4)  are  the  two  fill  edges  that  result  from  the  elimination  of  the  vertices 
v,{)  and  v,3  respectively. 

Next,  we  apply  Corollary  7.1  to  the  cliques  Gft/g)  and  G{Us).  Since  the  neighborhoods  of  the 
vertex  sets  and  f/j  are 

=  {''’9* ''’12}  > 

=  {Vj,  v,^}  , 

by  Corollary  7.1  it  follows  that  the  elimination  graphs  ^|a"|  satisfy 

£|^,|=  E{V-U,)  • 

and 

EiV-U,)  Ut('’2*''.2)>  • 
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Thus,  if  we  let  a  denote  any  ordering  of  the  vertices  in  the  set  ^  U-  =  R,  then  by  Corollary 
7.2  it  follows  that  the  a-elimination  graph  G|g^|  satisfies 


|a| 


and 


Hence,  (vj.Vjj),  (V9,v,,)  and  (v,  ,v,2)>  and  (v,2.v,4)  are  the  four  fill  edges  that  result  from  the 
elimination  of  the  10  vertices  in  the  vertex  R  in  any  arbitrary  order.  Figure  4  shows  the  a-elimination 
graph  G|c^|  =  (Vjc^j,E|^|).  The  fill  edges  (v2.v,2)  and  (v,  .v,2)  are  shown  in  bold  lines. 


Figure  4.  The  a-elimination  graph  G  |^|  ^|ap' 


Once  the  a-elimination  graph  G|^|  is  computed,  the  graph  C  may  be  replaced  by  G|(^|  and  the 
entire  process  repeated  until  G|^|  is  a  clique.  Using  ICSiV)  as  the  basic  procedure,  this  recursive  ver¬ 
sion  of  constructing  independent  cliques  sets  and  elimination  graphs  takes  the  form  given  below. 

Again,  we  assume  that  the  input  graph  G={V,E)  to  the  procedure  NESTEDJCS  is  not  a  clique.  Also, 
we  assume  that  the  adjacency  lists  L[v|  and  the  integers  DEG\v]  are  known  for  all  v  in  T  at  each  pass 
of  the  repeat  loop  in  NESTEDICS. 


procedure  NESTEDICS: 

repeat 

begin 


/C5(V0; 

for  each  connected  component  G{U)  of  G{R)  do 
begin 

let  a  be  any  ordering  of  the  vertices  in  G; 
let  G|j^|  =  (T|(^|),£|jj|  be  the  a-elimination  graph; 

^  ^\a\ 

end 


end 

until  G(V)  is  a  clique 
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The  correctness  of  the  procedure  NESTEDICS  follows  from  the  correctness  of  the  procedure  ICS 
and  Corollaries  7.1  and  7.2. 

The  first  pass  of  the  repeat  loop  in  the  procedure  NESTEDICS  has  already  been  illustrated.  The 
output  at  the  completion  of  this  first  pass  consists  of  the  five-vertex  a-elimination  graph  G|(^|  shown  in 
figure  4.  Thus,  at  the  start  of  the  second  pass  of  the  repeat  loop,  we  have  C=G|^|. 

The  application  of  the  procedure  SEARCH  to  the  graph  in  figure  4  yields  F\  Vg]=T[vj2]=0  and 
F[v2  l=f^[v9  l=f^[Vi5]  =  l.  Thus,  at  the  completion  of  the  procedure  ICS  at  the  second  pass  of  the 
repeat  loop  in  NESTEDICS  produces  the  vertex  set 

R={V6.  v,2}  • 

The  connected  components  of  the  induced  subgraph  G{R)  are  G(U^)  and  GiU^),  where  U^={v^} 
and  G2={v,2}-  If  we  let  G'  =  {  V2,  v^,  v,,  v,;}  and  (/"  =  {  V2,  v,,  v,2,  Vjj},  we  get  int{U')-U\  and 
int{U")-U2,  which  means  that  both  of  the  induced  subgraphs  G(G,)  and  GiU'^)  are  elite  cliques  in  G. 

At  the  completion  of  the  second  pass  of  the  repeat  loop,  we  have  V-{  t'2>  ^'9.  t'ls }  a  result, 

the  procedure  NESTEDICS  halts  since  G(V0  is  a  clique.  Note  that  the  second  pass  of  the  repeat  loop 
in  NESTEDICS  did  not  give  rise  to  any  fill  edge  since  both  of  the  connected  components  G(t/,)  and 
G([/2)  of  Iho  induced  subgraph  G{R)  were  elite  cliques. 


MATRIX  INTERPRETATION  OF  THE  PROCEDURE  NESTEDICS 

Let  M  be  any  structurally  symmetric  matrix  with  a  nonzero  main  diagonal  and  let  G={V,E)  be  the 
graph  of  M.  Suppose  NESTEDICS  is  applied  to  the  graph  G={V,E)  and  let  denote  the  independ¬ 
ent  cliques  set  consisting  of  the  connected  components  of  the  induced  subgraph  G{R)  at  the  ith  pass 
of  the  repeat  loop  in  NESTEDICS.  Also  assume  that  NESTEDICS  terminates  at  the  completion  of 
the  (r-Uth  pass  of  the  repeat  loop.  Then,  in  matrix  terms,  the  procedure  NESTEDICS  restructures 
M  so  that  for  some  permutation  matrix  P,  PMP^-[Mij  ]  is  an  r  by  r  block  matrix  satisfying  the  fol¬ 
lowing  two  properties; 

(a)  is  an  |/'‘^|  by  jl^'^  I  block  diagonal  matrix  with  full  diagonal  blocks,  ;=1 . r-l. 

(b)  is  a  full  matrix. 

By  property  (a)  the  restructured  matrix  PMP  is  a  bordered  block  diagonal  matrix  with  respect  to 

the  independent  cliques  set  If  we  delete  the  first  k  block  rows  and  columns  of  PMp\  then  it  is 

easy  to  verify  that  the  remaining  (r-k)  by  (r-k)  block  matrix  is  a  bordered  block  diagonal  matrbc  with 

re.spect  to  the  independent  cliques  set  for  <:=1,  ...,  r-2.  Thus,  in  matrix  terms  the  procedure 

^  T 

NESTEDICS  restructures  the  matrbc  M  so  that  PMP  is  a  nested  bordered  block  diagonal  matrix. 

To  illustrate  this,  consider  the  15  by  15  matrix  M  shown  in  figure  5.  It  is  easy  to  verify  that  the 
graph  G-(V,E)  in  figure  3  is  the  graph  of  the  matrix  M  in  figure  5. 
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Figure  5.  The  15  by  15  matrix  M. 


Since  G(V^),  ....  G(U;)  are  the  connected  components  of  G(R)  at  the  first  pass  of  the  repeat 
loop  in  NESTEDICS  and  G(  ll\ )  and  G(  U^)  are  the  connected  components  of  G{R)  at  the  second 
pass,  we  have  |/^''|=5  and  /^^’|=2.  Also,  we  have  r=3  since  at  the  completion  of  the  second  pass  of 
the  repeat  loop  the  subgraph  induced  by  the  vertex  set  V={  V2,V9,v,5}  is  a  clique.  Thus,  there  exists  a 
permutation  matrix  P  such  that  PMP^=[Mjj  \  is  a  3  by  3  block  matrix  while  M,,,  A/jj  and  A/33  ^ 

by  5,  2  by  2,  and  1  by  1  block  diagonal  matrices  respectively  with  full  diagonal  blocks.  The  block 
matrix  PMP  is  shown  in  figure  6 


T 

If  we  factor  the  structurally  symmetrix  matrix  PMP  so  that 

PMP^=LV. 

then  the  L  and  U  factors  take  the  forms  in  figure  7. 

The  eight  dark  circles  in  figure  7  correspond  to  the  four  fill  edges  (vj.Vjj).  (v9,v,,  ), 

and  Ignoring  these  eight  fill  elements,  the  L  and  U  factors  have  precisely  the  forms  of  the 

T 

lower  and  upper  triangular  part  of  the  restructured  matrix  PMP  . 


Figure  7.  The  L  and  U  factors  of  PMP^. 


IMPLICIT  FORM  OF  AN  ELIMINATION  GRAPH 

Computer  implementation  of  elimination  graphs  having  the  explicit  form  given  in  Corollaries  7.1 
and  7.2  can  be  very  costly.  George  and  Liu  (1981)  cover  this  subject  in  great  depth  and  detail.  Ex¬ 
plicit  elimination  graphs  suffer  two  disadvantages.  First,  they  require  sophisticated  data  structures  to 
accommodate  possible  changes  in  the  structure  of  a  graph.  Second,  additional  space  is  required  to 
store  the  fill  elements  that  can  be  large.  Another  difficulty  is  the  unpredictability  of  the  amount  of 
storage  needed  at  various  stages  of  the  elimination. 

George  and  Liu  (1981)  advocate  the  use  of  implicit  elimination  graphs  to  eliminate  these  disad¬ 
vantages.  Implicit  elimination  graphs  have  small  and  predictable  storage  needs  and  use  the  original 
adjacency  list  representation  of  the  graph  throughout  the  elimination  process.  The  key  idea  in  the  im¬ 
plicit  model  is  based  on  the  concept  of  reachability. 

For  any  set  of  vertices  U  in  the  graph  G-{V,E)  and  for  any  vertex  s  in  the  set  V-U,  the 
reachability  of  s  in  G  with  respect  to  the  set  U  is  the  vertex  set  ReachQ{s,U)  defined  by 

Reach q{s,IJ)  =  {v  G  T-fZ-fs}!  there  exists  a  path  from  v  to  s  in  G((/  U  {i.v}). 

In  other  words,  all  information  about  the  structure  of  an  elimination  graph  can  be  extracted  from 
the  original  graph  through  the  concept  of  reachability. 
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While  the  concept  of  reachability  eliminates  the  major  drawbacks  of  an  explicit  representation  of 
an  elimination  graph,  the  amount  of  work  required  to  traverse  paths  in  the  original  graph  to  generate 
a  reachability  set  can  be  costly  in  the  case  when  the  vertex  set  U  is  large.  To  circumvent  this  problem, 
George  and  Liu  (1981)  advocate  the  use  of  quotient  graphs.  In  subsequent  developments,  we  borrow 
from  this  idea  to  facilitate  the  computation  of  implicit  elimination  graphs. 

Let  /j.  be  any  independent  cliques  set  in  the  graph  G={V,E).  Let  G((7)  be  any  element  ol  4  and 
let  S=V-U.  Since  G(U)  is  a  clique  and  thus  a  connected  graph,  it  is  easy  to  verify  that  the  reachability 
of  any  vertex  s  e  N U  with  respect  to  the  vertex  set  U  satisfies  the  following  relation. 

Reach^■(s,U)=adj(^^J  _[j^s  u  {N'^U-{s}). 

If  U  is  a  large  set,  the  construction  of  Reach may  require  the  traversal  of  long  paths  in  G. 
As  we  show  next,  a  minor  modification  of  the  graph  G  solves  this  problem. 

Suppose  we  introduce  a  single  vertex  c.  an  edge  set  defined  by 

£^  =  {(.v,c)|s'  e  Nf-.U}  , 

and  the  graph 

G'  =  (S  u  (c'}.  E{S)  U  £c). 

Then,  by  the  construction  of  the  edge  set  E^  it  is  immediate  that  the  reachability  of  the  vertex  s 
in  the  graph  G'  is  given  by 

£enc/!(j.(.v,{c})=a(4G(V-U)^  U 

and  so  we  get 

Reach (s,  {c})=Reach  q(s,  U),  (4) 

for  all  -v  G  Thus,  the  reachability  of  a  venex  5  in  the  set  NqU  remains  unchanged  if  the 

original  graph  G  is  replaced  by  a  combination  of  the  induced  subgraph  G(5),  the  vertex  c  and  the 
edge  set  E^  . 

The  graph  G'  is  extremely  attractive  from  computer  implementation  standpoint.  Every  path 
traversed  in  G'  to  construct  Reach  (s,U)  is  either  of  length  one  or  two  whereas  the  paths  traversed 
in  G  to  con.struct  ReachQ(s,V)  can  be  arbitrarily  long  depending  on  the  size  of  U.  Thus,  replacing  the 
original  graph  G  by  G"  speeds  up  the  computation  of  the  reachability  set. 

Since  the  elements  of  an  independent  cliques  set  are  disconnected  cliques  in  the  induced  subgraph 
G{X),  the  transformation  of  G  to  G’  can  be  naturally  extended  to  account  for  all  the  elements  of  an 
independent  cliques  set.  This  is  our  next  objective. 

Suppose  I  4  1=^-  Let  G(  L/,) . G(  U0  be  the  k  elements  of  4  ^nd  let 

5=V'-(G,  U  ...  U  G*). 

Following  the  previous  approach,  suppose  we  introduce  a  vertex  set  C  consisting  of  k  vertices: 

C={c, . c*}. 

an  edge  set  E^  with  k  disjoint  parts: 

U  ...  U  , 


31 


where 


£c,={(5.  Ci)\  e 


i=\ . k. 


and  the  graph 


G'=(V(S)  U  C,  E(S)  u  Ec)- 

Then,  by  the  property  that  the  eJements  of  the  independent  cliques  set  are  disconnected  in  the 
induced  subgraph  GfV-S)  it  follows 


ReachQ,(s,C)=ReachQis,(U:  U-  -U  G^),  (5) 

for  all  s  S  S.  The  similarities  between  relations  (4)  and  (5)  are  obvious. 

Note  that  the  graph  G'  contains  two  distinct  sets  of  vertices  S  and  C.  Each  vertex  in  the  set  S  is  a 
vertex  in  the  original  graph  G,  whereas  each  vertex  in  C  represents  an  element  of  the  independent 
cliques  set  .  Since  each  element  of  is  a  clique,  we  call  a  vertex  in  C  a  clique  vertex.  Similarly, 
we  call  a  vertex  in  the  set  S  a  separator  vertex  since  all  the  elements  of  ^  are  disconnected  graphs  in 
C(V-S).  Also  note  that  no  edge  in  the  graph  G'  connects  two  clique  vertices,  and  in  view  of  this 
property  and  the  fact  that  G'  consists  of  two  distinct  types  of  vertex  sets,  we  call  G'  the  semibipartite 
farm  of  G  with  respect  to  the  independent  cliques  set  /^.  George  and  Liu  (1981)  called  a  minor 
variant  of  G'  a  quotient  graph  while  a  clique  vertex  is  referred  to  as  a  supernode. 

Figure  8(a)  shows  the  semibipartite  form  of  graph  G  in  figure  3  with  respect  to  the  independent 
cliques  set  while  figure  8(b)  shows  the  semibipartite  form  of  the  elimination  graph  G|q|  in  figure  4 
with  respect  to  the  independent  cliques  set  The  bold  lines  in  figures  8(a)  and  8(b)  denote  the 
edges  in  the  edge  set  £<- •  From  figures  3,  4  and  8(a)  it  is  easy  to  verify  the  following: 


/?cac/!(7(i  j,  R) 
Reacha{V(,.R) 
ReachQivg,  R) 

ReachQ{v^2’ 

Reachcfv^y  R) 


ReachQ.(v^,  C) 

{Vj,  v,,  V,2,  Vjj) 

ReachQ-iv^,  C) 

{v2.V,.Vi5}  , 

Reachfj.ivg,  C) 

la  1 

{'’z*  '’6’  '"'iZ'  ''15) 

Reach 

1  a  1 

=  {V2,V,,V15)  , 

ReachQ.iy^^,  C) 

=  /i5  = 

la  1 

^  {''2,V6,V,,V,2} 

Note  that  the  reachability  sets  given  above  are  computed  by  traversing  paths  of  length  one  or  two 
in  the  semibipartite  graph  G'. 

The  graph  G'  in  figure  8(a)  nicely  serves  for  demonstrating  Corollary  6.1.  Since  the  vertex  Vjj 
is  not  adjacent  to  any  clique  vertex  in  G',  it  follows  that  Vjj  is  an  element  of  the  set 

U  ...  U  ^qU^)-  Thus,  if  we  let  G5={v,5},  then  by  Corollary  6.1  it  follows  that  the  set  of 
cliques  u  {G(G5)}  is  an  independent  cliques  set  in  G. 

Let  be  the  independent  cliques  set  consisting  of  the  connected  components  of  the  subgraph 
induced  by  the  vertex  set  R  generated  by  the  procedure  ICS.  Also,  let  G'  =  (V'(S)  u  C,E{S)  KjE^)  be 
the  semibipartite  form  of  G  with  respect  to  the  independent  cliques  set.  Then,  the  implicit  version  of 
the  procedure  NESTEDICS  takes  the  following  form. 
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procedure  NESTEDICSJ: 

repeat 

begin 

ICS{V); 

for  each  vertex  ^  in  S  do 

DEG[sj  -t—  \ReachQ-{s,C)\\ 
V  *-  S 

end 

until  G{V)  is  a  clique 


(b)  Semibipartite  form  of  G  |q|  with  respect  to  . 

Figure  8.  Semibipartite  forms  of  graph  G  and  elimination  graph  ^|a|- 
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CONCLUSION 


Let  A  be  any  symmetric  matrix  and  let  G  be  the  undirected  graph  of  A.  In  this  work,  we  develop 
a  new  separator  theory  for  partitioning  the  vertex  set  in  G  into  two  disjoint  sets  such  that  if  the  matrix 
A  contains  decoupled  blocks  that  can  be  factored  in  parallel  and  without  giving  rise  to  any  fill  element 
in  A,  then  the  vertices  representing  the  rows  of  these  decoupled  blocks  are  contained  in  only  one  of 
the  two  disjoint  vertex  sets.  If  there  are  no  such  blocks  in  A,  then  we  derive  an  ordering  scheme  that 
compromises  between  sparsity  and  parallel  computation  issues.  Our  partitioning  algorithm  has  running¬ 
time  proportional  to  the  number  of  vertices  and  edges  in  G.  Using  this  partitioning,  we  derive  a  block 
algorithm  for  the  solution  of  sparse  symmetric  linear  systems  of  equations.  The  algorithm  takes  full 
advantage  of  the  parallel  and  vector  capabilities  of  high-performance  computers,  and  makes  extensive 
use  of  standard  routines  for  dense  problems  to  perform  the  numerical  computations.  Finally,  we  estab¬ 
lish  connections  between  our  method  and  some  well-known  block  techniques  such  as  bordered  block 
diagonal  decomposition,  substructuring,  and  incomplete  nested  dissection. 
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